Necessity of negativity in quantum theory 
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A unification of the set of quasi-probability representations using the mathematical theory of 
frames was recently developed for quantum systems with finite dimensional Hilbert spaces, in which 
it was proven that such representations require negative probability in either the states or the effects. 
In this article we extend those results to Hilbert spaces of infinite dimension, for which the celebrated 
Wigner function is a special case. Hence, this article presents a unified framework for describing the 
set of possible quasi-probability representations of quantum theory, and a proof that the presence 
of negativity is a necessary feature of such representations. 



Introduction. The seeds of the so-called quasi- 
probability distributions of quantum mechanics where 
sown in 1932 by Wigner and the now famous function 
which bears his name. The Wigner quasi-probability 
distribution is a function on the classical particle phase 
space which represents the quantum state of a particle. 
In fact, the Wigner function is prescribed by a mapping 
placing the quantum state space in one-to-one correspon- 
dence with (a subset of) functions on phase space. If not 
for its negative values, the Wigner function would be a 
bona fide joint probability distribution of the position 
and momentum of a quantum particle. 

The fact that the Wigner function is but one of in- 
finitely many choices of such quasi-probability distribu- 
tions suggests the search for a true joint probability dis- 
tribution representing the quantum state of a particle. 
However, it was Wigner himself who proved that such a 
quest is futile [l| . Precisely, Wigner showed that a linear 
map W which assigns to each quantum state p a proba- 
bility density p, p {q,p) > does not exist if it also satisfies 
the marginal properties: 
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(2) 



There is a strong tradition in physics, especially 
in quantum optics, of considering negativity and re- 
lated features of the Wigner function and similar quasi- 
probability representations as a tool to identify strictly 
non-classical features of quantum states Q. However, 
it should be understood that any such representation is 
non-unique and to some extent arbitrary. Moreover, in 
most, if not all, of these representations the kinematic 
or ontic space of the representation is presumed to be 
the usual canonical phase space of classical physics. In 
the broader context of attempting to represent quantum 
mechanics as a classical probability theory, the measur- 
able space need not necessarily correspond to the phase 
space of some classical canonical variables. Here we con- 
sider the problem of whether it is possible to construct 
a classical reformulation of quantum mechanics, analo- 



(q\p\q) = / v P (q,p)dp, 

Jn 

(p\p\p) = / P P (<l,P)dq- 



gous to the one ruled out by Wigner but allowing for 
an arbitrary measurable space, that is, not restricted to 
the phase space of a classical physics. More precisely, 
we are considering the broad class of representation ob- 
tained by any injective affine function mapping quan- 
tum states to probability measures. Since we are in- 
terested in mapping probabilistic state spaces to each 
other, we require our mappings to be affine. Affine maps 
are those which preserve convex (equivalently, probabilis- 
tic) combinations Q. We write such a map formally 
T : <S(%) —> <S(f2,E). Here, (O, E) denotes a measurable 
space, where E is a a-algebra. Over this space, A4g(n, E) 
denotes the bounded signed measures while E) de- 

notes the bounded measurable functions. A signed mea- 
sure generalizes the usual notion of measure to allow for 
negative values. The classical states are the probability 
measures 5(0, E) C A / (R(fi,E). On the quantum side, 
S(H) denotes the convex set of quantum states; that is, 
density operators acting on H. 

Let B s {rl) denote the bounded self-adjoint operators 
acting on H. It was shown in reference [4] that for ev- 
ery quantum observable A £ B S (H), every e > 0, and 
any finite collection of states {pi} C S(H) there exists a 
classical observable function / £ J~m.(£1, E) such that 



Tr( Pi A) - / / d{Tp t ) 



< e 



holds for each pi. The result tells us, remarkably, that 
the expectation values calculated via the Born Rule are 
empirically indistinguishable from those calculated using 
the classical rule. For finite dimensional quantum sys- 
tems a stronger result holds [5(: there exists an affine 
injective map T : iS(C d ) — > S(R d ), from density matri- 
ces to probability vectors, such that for every Hcrmitian 
matrix A there exists a random variable r £ M. d such 
that 



Tv(pA)=J2n(Tp) t . 



i=l 



Here, the expectation values calculated via the Born Rule 
are exactly those calculated using the classical rule. 
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The authors call the mapping T a "classical repre- 
sentation". However, the above representations possess 
some peculiar features. The classical effects are the mea- 
surable functions taking values in [0,1]. These are de- 
noted £(fi,£) C Jk(^,S) [I- The quantum effects, de- 
noted £{%), are the positive operators acting on H and 
bounded above by 1. As shown in reference while 
the quantum observables can be reproduced using the a 
classical representation, the quantum effects cannot. 

In the present work we show that representations con- 
structed as above are not consistent with classical prob- 
ability theory because they still require a notion of nega- 
tive probability - in particular, in their representation of 
measurements. Our approach builds on the work of Ref- 
erences @,H[, which develops an approach to representing 
quantum mechanics that takes into account the require- 
ments for representing both the states and measurements 
in a self-consistent manner within the framework of clas- 
sical probability theory. In that work it was shown that, 
for finite dimensional quantum mechanics, non- negative 
representations do not exist. 

The results in Reference Q, H| were stated only for 
those quantum systems with associated Hilbert spaces 
of finite dimension. While conjectured to be true, the 
question of whether or not those results held for infinite 
dimensional systems was left open. Here we give a more 
general framework consistent with both finite and infinite 
dimensional Hilbert spaces. Precisely, we prove that each 
quasi-probability representation is equivalent to a frame 
representation and such representations require negativ- 
ity. 

We first begin with a review of the frame formalism of 
Reference @, [q- 

Frame representations in finite dimensions. 

Consider the Hilbert space C d with d < oo and the set f2 
with d 2 < |fi| < oo. 

A frame for the Hilbert space of Hcrmitian operators 
is a set of Hermitian operators {Fj : j £ ft} which satisfy 

a||A|| 2 <^[Tr(F,A)] 2 <&||A|| 2 , (3) 
jen 

for all Hermitian operators A and some constants a,b > 
0. Note that if |f2| = d 2 then a frame is equivalent to a 
basis. 

The key feature of a frame is its reconstruction for- 
mula: given a frame F any Hermitian operator A can be 
written 

A = ^Tr(i^A)£> i , (4) 

jen 

where the set of Hermitian operators {Dj : j G fi} is 
called a dual frame of F. When F is a basis, the dual 
frame is unique. Otherwise, there are infinitely many 
choices for a dual. 



A classical representation of quantum mechanics is a 
pair of affine mappings T : 5(C d ) -)• 5(fi), 5 : £{£ d ) -)• 
£{Q) which satisfy 5(0) = and 

Ti(pE) = J2(Tp) j (SE) j , (5) 

for all p G S(C d ) and all E G £(C d ). Note that, since 
the classical effects are probabilities, Equation (J5j) is the 
classical Law of Total Probability. Unfortunately, a clas- 
sical representation does not exist [H, • Relaxing only 
the condition of positivity was proposed as the appropri- 
ate definition of a quasi-probability representation. That 
is, a quasi-probability representation of quantum me- 
chanics is a pair of affine mappings T : S(C d ) — > MP, 
5 : £(C d ) -> R n which satisfy 5(0) = and 

jen 

Tr(pE) = J2(Tp)j(SE) j , 
jen 

for all p G S(C d ) and all E G £{C d ). 

It was shown in that (T,5) is a quasi-probability 
representation if and only if 

(Tp^Tr^) 
(SE), = Tr(EDj), 

where {F } ■ : j E £1} is a frame and {Dj : j G 0} is 
one if its duals. Armed with these results we can begin 
to create quasi-probability representations of quantum 
mechanics. First, we choose one of the many so-called 
discrete Wigner functions [T3|. Second, we identify the 
frame which gives rise to it. Last, we compute its dual 
frame to obtain the second half of the quasi-probability 
representation. 

Given a quasi-probability representation (T, 5) , note 
that the frame F satisfies 

jen 

Thus, if the quasi-probability representation satisfies 
TS(C d ) C 5(0), the frame is an informationally complete 
positive operator valued measure (IC-POVM). Similarly, 
the dual frame D satisfies 

Tr(Dj) = 1, 

for all j G O. Thus, if the the quasi-probability represen- 
tation satisfies S£(C d ) C £ (f2), the dual frame is a set of 
density operators. 

These definitions and results are tailored to the case 
d < oo. Now we will extend them to infinite dimensions 
answering the questions left open. 

Frame representations in infinite dimensions. 
For the remainder suppose that the dimension of the 
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Hilbert space H is arbitrary and let (f2, £) be a measur- 
able space. In this section we define the generalization 
of frame to the space of self-adjoint trace-class operators 
%{%). 

Recall that a frame for Hermitian matrices is equiva- 
lent to an informationally complete operator valued mea- 
sure (no positivity required) . If not for the allowance of 
negative eigenvalues, a frame would be an IC-POVM. So, 
we generalize the definition of informationally complete 
observable for infinite dimensions and define an opera- 
tor valued measure as a map F : E — > B s (T-l) satisfying 
F(0) = 0, F(Q) = 1 and 

(oo \ oo 
i=l / i = l 

where the sets B L G E are mutually disjoint and the 
sum converges in the weak sense. A frame for 7^(H) is 
an operator valued measure F for which the map T : 
r s (H)^Mt(fl,S), 

T(W)(B) :=Tr(WF(B)), 

is injective. The map T is called a frame representation 

Similarly, generalizing the reconstruction formula (j4j 
yields the generalized notion of a dual. That is, given a 
frame F, a dual frame to F is a map D : Q B S (H)* , 
the dual space, for which the function 

{SA)(w) := {D{w)){A) 

is measurable and satisfies 

A= f SAdF, (6) 

for all A G B S (H) [ll|. 

Classical and quasi-probability representations. 

Now we will generalize the definition of classical repre- 
sentation to the more general measurable space (f2, E). A 
classical representation of quantum mechanics is a pair of 
mappings T : 5(H) -> 5(17, E) and 5 : 5(H) -> £ (fi, E) 
such that 

1. T and 5 are affine. 

2. 5(0) = 0. 

3. For all p G 5(H) and E G 5(H), 

Tr(pF) = f (SE)d(Tp). (7) 

As expected, we have 

Theorem 1. A classical representation of quantum me- 
chanics does not exist. 



Proof. Suppose T and 5 form a classical representation 
of quantum mechanics. Conditions 1 and 2 imply that 
T and 5 can be extended to bounded linear functions 
T : Ts{U) -> A4 R (0,E) and 5 : B S {U) -> Jk(0,E). 
Thus for all W G 7^(H) and A G B s {%), condition 3 
gives 

Tr(WM) = [ (SA)d(TW) = Tr(W(T' SA)), (8) 
Jo 

where T' denotes the dual of the map. Hence for all 
A G B S (H), A — T'SA. S must be injective, and so S*" 1 
exists, and if R(S) is the range of S, then T'\ R ^ = S^ 1 . 
Therefore 

t's (n, e) d T'| fl(S) f (n, e) = s*- 1 ^^, E) D f (W). 

Also, if / G S(Q, E) and G 5(H), then 

0< / fd(TW) = Tr(W(T'f)) < [ d(TW) = 1, 

so T'/ G 8(H) and T'f(0,E) C 8(H). Therefore, 
T'£(fi,£) =f(H). 

However, this is a contradiction since T'£(il, E) C 
f(H) is a proper inclusion [4]. A short and intuitive 
proof that the inclusion is proper was briefly mentioned 
by Bugajski in Reference [12|. The proof relies on the 
notion of coexistent effects (See reference [HI and refer- 
ences to G. Ludwig therein). Intuitively, two (classical 
or quantum) effects are coexistent if they can be mea- 
sured together. Any two classical effects are coexistent 
while two quantum effects are not necessarily coexistent. 
Since T" is a linear operator, it preserves the coexistence 
of effects. That is, the set T'£(£l, E) is one in which 
any two elements (quantum effects) are coexistent. But, 
again, not all quantum effects can be measured together. 
Hence the inclusion is proper. □ 

In analogy with the finite dimensional case, we gener- 
alize the definition of a classical representation to allow 
for "negative probabilities" . A quasi-probability repre- 
sentation of quantum mechanics is a pair of mappings 
T : S(H) -4 A^ R (fi,E) and S : 8(H) -> Jk(^,E) such 
that 

1. T and S are affine, T is bounded. 

2. Tp(Q) = 1. 

3. 5(0) = 0. 

4. For all p G 5(H) and E G 5(H), 

Tr(pE) - / (SE)d(Tp). (9) 
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Since a quasi-probability representation in which 
TS(H) C S(il, E) and S£{H) C £(0, S) is a classical 
representation, we have immediately from Theorem [TJ 

Corollary 1. A quasi-probability representation of quan- 
tum mechanics must have, for some p £ S{J-L), E £ £(H) 
either {Tp){B) < for some B £ E or (SE)(u) & [0, 1] 
for some u> £ Q. 

Note that, strictly speaking, we could have SE(lu) > 1. 
However, we still refer to this as negativity since SE(lu) is 
meant to be interpreted as a probability and l — SE(u>) < 
should stand on the same footing. Thus, the above 
corollary gives us the necessity of negativity in quasi- 
probability representations. 

Necessity of frames. It is easy to verify that ev- 
ery frame representation defines a quasi-probability rep- 
resentation. The converse is also true as established by 
the following theorem: 

Theorem 2. The pair (T, S) is a quasi-probability rep- 
resentation of quantum mechanics if and only if T is a 
frame representations of7~a(Ji) o,nd S is a dual frame. 

Proof. Assume (T, S) is a quasi-probability representa- 
tion. Define F(B) := T'xb- By the definition of the 
dual map 

Tr[pF(B)} = Tt[pT'xb] = f X B d{T p) = (Tp)(B). 

Jn 

It is clear then that F(0) = and F(fi) = 1 by 
normalization. The cr-additive can be verified by di- 
rectly substituting the union of an arbitrary sequence 
of disjoint sets {B{\ C E. It is known that T and S 
can be uniquely extended to bounded linear mappings 
T : T s (n) -> M R (n, E) and S : B S (H) ->• Jk(fi, E). Now 
suppose TW is the zero measure for some W £ T S ('H)- 
Prom the last property of a quasi-probability representa- 
tion, the Law of Total Probability, we have 



Tt(WA) = / (SA)d(TW) = 0. 

Since this is true for all A £ B s (U), W = 0. There- 
fore T is injective, and we have shown that T is a frame 
representation. Now define D u — S*6 U . So we have 

D U (A) = S*S U (A) - / (SA)dS u = (SA)(w). 

And, again from the Law of Total Probability, 

Ti[WA] = [ (SA)dTi[WF] = Tr W [ (SA)dF 
Jn L Jn 



Hence 



A = [ (SA)dF, 
Jn 



Conclusion. We conclude with an example: the cel- 
ebrated Wigner function. We want a joint probability 
distribution p p {p,q) for the state of the quantum sys- 
tem. From the postulates of quantum mechanics we have 
a rule for calculating expectation values. In particular, 
we can compute the characteristic function 



Tr(e 



i(aP+p,Q) 



P), 



where Q and P are the position and momentum opera- 
tors. Since the characteristic function is just the Fourier 
transform of the joint probability distribution, we simply 
invert to obtain 



i(aP+p,Q) 



p)e 



dadp. 
(10) 

which is the Wigner function of p 14 1. The mapping 
T : p h- > p p is linear and injective and hence we can find 
a frame F such that 

Mp(P>?) = Tr[F(p,<?)p] . 
And, indeed, it is quite easy to see that the frame is 
1 



F{p,q) = 



(27T) 



o ia(P-p)+i t j.(Q-q) 



da dp. 



This frame has the interesting property of being tight: it 
posses a dual frame which is proportional to itself. Thus 
the Wigner function can be inverted via the reconstruc- 
tion formula 

p = 2tt / / p p {p, q)F{p, q)dpdq. 
J Jr 2 

Defining the dual frame as S : E i-> 2TrTr[F(q,p)E] gives 
us a full quasi-probability representation of states and 
measurements. 

In this paper we have shown that the frame represen- 
tations provide a unification of both finite and infinite 
dimensional quasi-probability representations. We have 
also proven that no classical representation of quantum 
theory exists or, equivalently, any quasi-probability rep- 
resentation of quantum theory requires negativity. 
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and by definition D is dual to F. 



□ 
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